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Abstract 


Individual-level interactions and decisions spread though populations and 
change the collective-level dynamics in an intricate way. Nevertheless, 
game theory is well suited for the unification of these viewpoints. This 
thesis introduces the works The strength of diversity and Decisions and 
disease: a mechanism for the evolution of cooperation, which show that 
games have broad applications in population dynamics modeling. 


In The strength of diversity we calculate the equilibrium strategies of the so- 
called game of teams. The game of teams is an individual-level competition 
between teams, and a team’s strategy in this context is a distribution of 
strength over the team members. It turns out that the equilibrium strategies 
are flat distributions or ‘alternating’ flat distributions whenever there exists 
equilibrium strategies. 


In Decisions and disease: a mechanism for the evolution of cooperation 
we combine the classic SIR and SIS models from epidemiology with the 
prisoner’s dilemma game. The transmission rate is computed as the aver- 
age over defecting and cooperating individuals, and the individuals are 
subjected to a replicator equation that takes into account the portion of in- 
fectious members of the population. We compute the steady state solutions 
and interpret the results. 


Keywords: game theory, non-cooperative game theory, prisoner’s dilemma, 
equilibrium strategy, disease, distribution, compartmental model, epidemi- 
ological model, 
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Notation, abbreviations and nomenclature 


Z 

R 

a.e. 

game 
equilibrium 
E 


The integers ..., —2, —1, 0, 1, 2, ... 

The real numbers 

Almost Everywhere 

A collection of players, payoff functions and strategies 

A state where no player has incentive to change strategy 
Expectation, see §2.2 

Expectation of normalized strategies, payoff 

Competitive Ability 

Mean Competitive Ability 

The upper bound on MCAs; the cost in Donor-Recipient 
games 

A compartment model with categories susceptible, infec- 
tious and removed 

A compartment model with categories susceptible and in- 
fectious. Typically, this models a disease without immunity. 


Chapter 1 


Games, members and 
populations 


Game theory is the appropriate tool whenever the success of 
an individual depends on others. 
—Martin A. Nowak and Karl Sigmund (Science, 2004) 


Game theory is the study of decision-making under conflicting interests. 
When the actions undertaken by a decision-maker affects the considera- 
tions of other ‘players’ there is a mathematical procedure to find the overall 
‘best choices’ and also the rational choices from each player’s perspective. 
Oftentimes, they differ; the overall best is never achieved because it it does 
not seem rational from an individual perspective. These insights are high- 
lighted by game theory thanks to its simple rules. Although simple, game 
theory analyses are an essential part of modern decision-making. Today, 
agreements such as the Kyoto protocol (on reducing the climate footprint 
worldwide) undergo game theory analysis. Economy, negotiation, trade, 
resource management, ecology and physics are just some examples of 
applications of the modern game theory that was formalized during the 
20th century. (Mazalov, 2014) 


Although games were discussed systematically long before, certainly al- 
ready in ancient times (Ross, 2021), the starting point of today’s rigorous 
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treatment of game theory and applications is widely considered the book 
The Theory of Games and Economic Behaviour (1944) by J. von Neumann 
and O. Morgenstern. Later pioneers such as J. Nash, L. Shapley, J. Maynard 
Smith and others have refined the theory and expanded its applicability. 


This thesis comprises the two articles The strength of diversity and Decisions 
and disease: a mechanism for the evolution of cooperation, which are both 
fundamentally oriented investigations that show how individual-level 
interaction and collective-level dynamics are unified by means of game 
theory. These papers do also show the generality of applications. The 
results are abstract and not restricted to a certain context or interpretation. 


1.1 The early days of game theory 


We begin this chapter with one of the most important results of game 
theory, namely an explanation of the tragedy of the commons. In a group 
of decision-makers, the tragedy of the commons is in general a situation 
where no participant seeks to cooperate for the common good even though 
such cooperation would benefit every participant. 


1.1.1 A motivating example in game theory 


Climate change is a major issue that has led to much negotiation between 
countries. Consider a meeting between two countries that can either defect 
from an issued agreement or decide to cooperate within the agreement. 
If both cooperate, they each get a climate benefit of 6 (in some unit, e.g. 
a monetary currency or natural resources), whereas if only one of them 
cooperates they receive a lower climate benefit of 3. Cooperating costs 4. 
This leads to the following total payoffs: If both abate, both get 6 — 4 = 2. 
If both defect, both get 0 — 0 = 0. If only one abates, the abater gets 
3 — 4 = -1, and the defector gets 3 — 0 = 3. Now each country has the 
following options to consider: If the other country decides to cooperate, 
then defecting guarantees a benefit of 3 while cooperating gives 2. If the 
other country decides to defect, then defecting comes with a benefit of 
0 and cooperating gives —1. That is, if the other’s strategy is not known 
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it is always better to defect. The same goes for the other country. The 
rational choice is therefore to defect, not abate. This situation — both 
players defect as they do not trust the other player to cooperate even 
tough the common good would benefit most if both would cooperate — is 
the essential mechanism of the tragedy of the commons. 


It is standard procedure to write these possible outcomes in a matrix as in 
the figure below. Here, C denotes the option ‘cooperate’ and D denotes 
‘defect’ Each box contains the gain to each player such that the top-right 
number belongs to the player B. The above example is symmetric since 
both players have the same set of actions and are paid the same payoffs. 


player B 
C D 

z 2 3 
p: 2 -1 
S, 
= -1 0 
>D 

3 0 


The concept of rational decision from an individual’s point of view is 
captured mathematically by the notion of equilibrium. In an equilibrium, no 
player has incentive to change strategy. Borel formulated and studied game 
equilibria in the early 20th century for two-player games and same did von 
Neumann during the 20’s though the 40’s. The equilibrium concept was 
extended to include n players by J. Nash in the 50’s. (Hammond, 2003) Nash 
proved that any game with n players has a symmetric equilibrium (Nash, 
1951) and a game’s equilibrium is therefore often called Nash equilibrium. 
In the above example, there is an equilibrium when both players defect. 


A. Tucker named the above game the prisoners’ dilemma as a way to 
popularize Nash’s ideas to the psychology community. M. Flood and 
M. Dresher discussed games with the structure of prisoner’s dilemma in 
1950, but neither they nor Nash published their ideas immediately. (Kuhn, 
2019) 
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In this thesis we consider repeated games with the possibility to change 
action when a new turn is played as long as there is a fixed probability 
distribution of choices. Such a distribution was named a mixed strategy 
by Nash. In the example above there were two options (C and D) for 
each player, so if a player plays C with probability x then the same player 
chooses D with probability 1 — x. In this case we can compute what 
payoff is expected, statistically. The equilibrium of a game is then defined 
as above with the assumption that each player wants to maximize its 
expected payoff. A pure strategy assigns probability 1 to only one option. 


In non-cooperative game theory, players do not reveal their intentions to 
other players and they therefore act to maximize the individual payoff that 
they receive. In contrast to this, cooperative games follow a different set 
of rules. There are no individual payoffs but the game has an overall value 
which is determined by the values of the ‘coalitions’ that form in the game. 
This thesis will only concern non-cooperative games, but the interested 
reader is encouraged to consult the founding work by Shapley (1953) for 
an introduction to cooperative games. 


Chapter 2 of this thesis investigates the Nash equilibria of a game of 
competing teams. In Chapter 3, the above symmetric matrix plays a 
particularly important role in the context of changing behaviors during a 
disease outbreak. 


1.1.2 A motivating example in population dynamics 


‘How can one explain such oddities as snakes that wrestle with each other, 
deer that refuse to strike “foul blows,” and antelope that kneel down to 
fight?’ asked biologists Maynard Smith and Price (1973). They used game 
theory and their newly developed notion of evolutionary stable strategies 
to explain why fighting between members of the same species usually 
do not escalate unless the opponent aim to cause severe injury. In this 
context, the strategies ‘cooperate’ and ‘defect’ are termed ‘conventional 
conflict’ and ‘dangerous conflict’ making the matrix-game formulation 
seen in the prisoner’s dilemma suitable. 
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In population dynamics games there is an evolution of strategies which 
are designs of a selection process during repeated games rather than the 
‘rational choices’ in Nash equilibria. This selection process can result in 
strategies that are different from the classical game from the previous 
section. Maynard Smith and Price (1973) performed computer simulations 
of repeated matrix-games and realized that the selection process leads to 
a classic equilibrium if in addition to Nash’s equilibrium condition there 
is a stability condition (Riechert and Hammerstein, 1983). A year later, 
Maynard Smith (1974) designed a mechanism that in some games displays 
the development from non-optimal strategies to the stable ones by means 
of an evolutionary process. We will encounter a version of these ideas in 
Chapter 3 when we consider games in combination with epidemiological 
models and identify the stable steady state solutions. 


Chapter 1. Games, members and populations 


Chapter 2 


The Game of Teams 


Talent wins games, but teamwork and intelligence win cham- 
pionships. 
—Michael Jordan (in I Can’t Accept Not Trying. 1994, Harper) 


The Game of Teams has been developed during the last couple of years as 
a model to explain why certain compositions of team members are more 
advantageous than others. Central to this game is the assumption that 
competition occurs on an individual level whereas strategies are defined on 
a team-level. This applies in a wide range of situations such as economy 
(portfolio theory, management etc.), research, sports, behaviorological 
sciences and ecology. It has been demonstrated that diversity is beneficial 
in all these contexts. Results from ecology shows that diversity is healthy 
for a biological system, for instance as protection against extinction of 
species. Similarly, a diverse portfolio of investments protects the investor 
from financial backlash in case individual investments are unstable. Teams 
of scientists perform better if they are diverse in all senses they can be. 


The game of teams do not treat teams as individuals and herein lies its 
importance. We construct a simple game in this chapter and we show that 
the teams that the success of a team depends heavily on the distribution 
of resources among its members. This provides an explanation to the 
strength of diversity without restricting the results to a specific context 
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(e.g. ecology.) 


2.1 Foundations of non-cooperative games 


The purpose of game theory was originally to explain conscious and 
rational decision making mathematically. Therefore it is assumed that all 
players in a game act to maximize their payoffs, with no other intentions 
than that. In a zero-sum game the gain to one player exactly equals the 
loss of the rest of the players. If all gains are added up (counting loss as 
negative gain), the sum is zero. 


Strategies and equilibrium. 


There are two formulations for two-person zero-sum games with a finite 
number of alternatives for each player: the normal form and the extensive 
tree form (Hammond, 2003). The normal form is also called the matrix form 
and we encountered this in §1.1.1 in the discussion on climate agreements. 
Only the normal form games are considered in this thesis. These games 
are determined by a static set of options and a payoff function for each 
player. A payoff is a mapping to the real numbers that depends on the 
other players’ decisions. 


A strategy is a rule for decision-making such that the payoffs in the game 
are determined once the strategies of all players are known. Let G denote 
the set of strategies. It may possess any structure (a finite set of values, a 
subset of R”, a set of measurable functions, etc.) 


An equilibrium is defined as a set of strategies such that no player has 
incentive to change strategy, assuming the other players’ strategies are 
unchanged. If we let {fj};_, denote a set of strategies and p; denotes the 
payoff to player i, then {fj}*_, is an equilibrium if for every i 


Pifo Jn) = max pil fr sadJizisgi Jitie fn): (2.1) 


As an example, an equilibrium in a 2-player game is a pair of strategies 
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(fi f2) meeting the conditions 


Pafi fe) = Pigi fr) 
poli, fo) = pe(fi 92) 


for arbitrary strategies gı and gp. If the game is zero-sum, then p; (fj, f2) + 


p2lfi. f2) = 9. 


2.2 The Game of Teams 


This section introduces the Game of Teams, which was first defined by 
Menden-Deuer and Rowlett (2019) and later revised and refined in the 
publication by Menden-Deuer et al. (2021). It was originally designed to 
explain the vast diversity among asexually reproducing (cloning) microbes 
and microbial subspecies, which gives it a terminology reminiscent of 
biology. We call the ‘players’ individuals and we refer to the groups of 
players that constitute a team as ‘species’ We may also use terms such as 
population size. 


In a well-mixed population, every member has a constant, positive prob- 
ability of meeting every other member. There are no closed groups but 
everyone has the same chance of meeting everyone. In a well-mixed pop- 
ulation we may consider ‘teams’ or ‘species’ as labels and assign different 
characteristics to these teams. Imagine that two such teams constitute a 
population and that for each timestep the members of the population meet 
with a member from the other species and compare ‘strength, meaning 
that 


+ if one member is stronger than the other, the stronger one defeats 
the weaker and then replicates, or 


e if both members are equally strong, it is a draw and both players 
remain in the game. 


A draw results in no change to the size of each team, but if a member 
of one team defeats a member from the other team there is an increase 
by one to the first team while the other team is reduced by one member. 
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Imagine that these indivual competitions take place simultaneously. If a 
member cannot be paired with another member, it waits until the rest of 
the members have compared strength. This is a timestep, or turn, in the 
game of teams. 


Strength is here a positive, real number. An individual’s strength is re- 
ferred to as its competitive ability, in short CA. It should be assumed that 
the competing species, or teams, are on average not stronger than some 
positive number C. Otherwise it would be easy to win: just let all mem- 
bers of your team grow stronger. Thus, teams are characterized by the 
distribution of strength among the team members. We therefore define! 
strategies in the following way. 


Definition 2.2.1. A strategy is a non-negative, Lebesgue-measurable, 
bounded function that is not identically zero, supported on a compact 
subset of [xo, co), for some real number xo. 


We should think of strategies as assignment rules. At each turn, the 
strategy is the distribution of CA over the population in the sense that 
each player gets a CA randomly following the probability distribution 
given by the normalized strategy under the constraint that the average of 
the CAs is not greater than C. Sometimes we do not distinguish a team 
from its strategy but rather we use strategy and team interchangeably. 


We will consider three classes of games. If no restrictions except those in 
Definition 2.2.1 are put on the strategies, we call this the bounded game of 
teams or the bounded measurable game of teams. If we consider continuous 
functions with support on a compact subset of [xo, 00) we refer to this 
as the continuous game of teams. Let M be a real number and let a be an 
integer. Define for all non-negative integers j the fractions 
jta 
xj = —. 2.2 

ya (2.2) 
If we consider strategies from this set of xj, we say that the game is the 
discrete game of teams. In this case we define strategies as follows. 


1Compare this with probability density functions; we assume not normalization but 
boundedness because ‘strength’ is never infinite. 
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Definition 2.2.2. A discrete strategy is a mapping n from {x;}j>0 into the 
non-negative, real numbers such that n(x;) is not identically zero and only 
finitely many n(x;) are non-zero. 


We will not distinguish discrete strategies if there is no risk of confusion, 
since it can be understood which definition that applies in most situations. 


Example 2.2.3. Assume that two teams of three players each are playing 
cards with a special kind of deck: the cards can have five values 1, 2, 3, 
4 or 5 and each team member can select one card as long as the average 
over the team is 3. Two or more players can select the same value. Each 
member pairs up with a member from the other team and the one having 
the highest value wins. What is the ‘best’ strategy in this situation? Let 
A be one team and B be the other. If A always plays with the number 3 
while B selects 4 for two of its members and 1 for the remaining member, 
which team is expected to win? In each turn, the number of players in A 
that are expected to win are the number of players in B that play 1 or 2 
and those players in B playing 4 or 5 will always win. Let ng(x;) be the 
number of members of B that play j. Then 


ng(xı) + ng(x2) — ng(x4) — ng(xs) (2.3) 


is the increase of members to team A at each turn. This sum equals 
1+0- 2-0 = —1 meaning that A wins one player but also loses two 
players; B wins the first turn. The teams are not equally strong even 
though their average strength is the same. Team B wins because it has a 
smarter distribution of competitive ability among its members. 


Let Ng denote the number of individuals in B. Interpreting ng(x;)/Ng 
as the probability that a random player in B has the strength xj, we can 
say that ng is a strategy. It is in fact the number of players in B that are 
expected to play xj. The team A plays with the strategy n4(x3) = 3 and 
na(x;) = 0 for j = 1,2, 4,5. 
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The expectation in competition between teams 


In general in the discrete game, the species A expects a population increase 
(or decrease) in competition with B given by 


Elna np] = NAN a(x) (Z-Z mc) (2.4) 


NaNp i>0 i>j i<j 


where an empty sum is interpreted as zero. The factor in front of the sums 
accounts for the situation that one team is smaller than the other. If, say, 
N4 = 100 and Ng = 99 then 


E[na, ng] = > nal) z ng(xj) — ` nts) 
iso A VSG i<j 
so that E[na, ng] is in absolute numbers, ranging from —99 to 99, which 
is exactly the minimal and maximal number of ‘lose’ and ‘win’ as one 
member of A cannot be paired with a member of B. If we are interested in 
the relative increase, we compute 


E[na, ng] 


Pinanel = in{Na Na} 


Game-theoretically, p[n,, ng] is the payoff to team A in competition with 
B. The relative expectation, p, ranges from —1 to 1. Passing between E and 
p simply means that we normalize the strategies. 


In the continuous game and the bounded game, we define the expectated 
win for a strategy f in competition with another strategy g as 


ELf.gl =a f fæl f TOE / atu) dy) ax (2.5) 


min | SE fœ) ax, [° g) dx} 
(LP Fæ ax) (JÈ g) ax) 


Again we define p as p[f, g] = E[f/F, g/G] where F and G are the integrals 
of f and g over [xo, œ), that is, we normalize them with respect to the 


where 


(2.6) 
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L! norm. Integration here means integration with respect to Lebesgue 
measure. 


It is easily checked that both E and p satisfy the ‘zero sum dynamic’ 


pPlf.gl+plg. f] =0 (2.7) 


in the bounded, the continuous and the discrete game. If more than two 
teams simultaneously compete we would like to consider one team in 
competition with the rest. Since 


Plf.91+ 92] = pif; g1] + plf. gl, (2.8) 


we may define the expectated payoff to f in competition with a collection 
of strategies {g;}"_, as p[ f, gi+...+gn]. The linearity property (2.8) does not 
hold for E due to the factor a, but nevertheless we define the expectation 
of f in competition with a collection of species {g;}"_, as E[f, g1 + ... + 
gn] because any species competes against all the others (otherwise their 
members would belong to the same species). 


An equilibrium (or equilibrium point) in the game of teams is defined as 
a collection of strategies {f;}"_, that satisfy the following condition: For 
each k € {1,2,...,n}, if team no. k changes its strategy but all other teams 
retain their strategies then the payoff to team no. k does not increase. This 
means that for all k € {1, 2,..., n}, 


PlRAtht+..+heithat--t+fil 2 pla ftft..theaitheart--t+hil 


for any strategy g of the same type (bounded, continuous or discrete). The 
strategies that comprise an equilibrium point are known as equilibrium 
strategies. 


This agrees with the definition of a Nash equilibrium. By the following 
proposition, it is equivalent to non-negative expectation in competition 
with any other strategy. 


Proposition 2.2.1. Assume that a collection of strategies { f;}"_, is an equi- 
librium point. Then they satisfy 


PIF. fe] = 9 forallk,j, and pl[f.,g] = 0 for any strategyg. (2.9) 


14 Chapter 2. The Game of Teams 


Equivalently, each fy is an equilibrium strategy for the two-player game. 
Conversely, if {fi}; satisfy (2.9) then {fi}; is an equilibrium of the game. 


A proof of this proposition is found in paper 1. 


Using this proposition in the identification of equilibrium strategies we 
find those strategies f that satisfy E[ f, g] 2 0 for all strategies g. It is never 
important to retain the factor a and neither is it important to normalize 
the strategies, since any equation on the form E[f,g] > 0 is equivalent to 


plf.g] = 0. 


In paper 1, we use the notation ø (this symbol is called the “Weierstrass p’) 
for the expectation E with a = 1. We also use the notation ¢[f; g1, ..., gn] = 
Lf, gı +... + gn]. Again, using E or g does not change which strategies 
are equilibrium strategies, so we may use g instead of p. 


A fair constraint on strategies. Translation invariance. 


A team could always get better if all members would be stronger, that is, 
if the CAs of the members were allowed to grow without any constraint it 
would be trivial to construct a winning team. Assume therefore that only 
teams with an average CA of less than or equal to some positive number 
C are allowed to compete. We will refer to this as the constraint on the 
mean competitive ability, or MCA, and we define 


Èk>o Xkn(xk) 


Duk>0 n(xk) 


in the discrete game, and in the bounded game as well as in the continuous 


MCA(n) = (2.10) 


game we define 


MCA(f) = a i xf(x)dx, Mee f fdz. (2.11) 


Notice that f is non-negative and 0 < ||f||z1 < œ by the definition of a 
strategy. Integrating over R is equivalent to integrating from xo to oo since 
strategies have compact support in [xo, œ). 


The game of teams is translation invariant and scale invariant. This means 
that given a collection of strategies we may assume that they are defined 
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on [0, 1] or some other interval, say [-1, 1]. If f and g are two strategies, 
their support is contained in a closed interval [a,b] such that a < C < b. 
Defining £ = b — a, C =(C-a)/€ and 


f(t) =f(tt+a), g(t)=g(tt+a) forte [0,1] (2.12) 
we have 


MCA(f) <C — = MCA(f) < Ĝ, 
MCA(g) < C — = MCA(G) < Č 


and p[ f ,9| = p| f, g]. This implies that the values of E and p are unchanged 
under the translations 


XH x+xo CHC+HX, (2.13) 


with xo € R in the bounded or continuous game, and correspondingly for 
the discrete game j +> j +a, C œ> C + xa with a € Z. In other words, it is 
only the relative distance to C that matters for the outcome of the game. 
Therefore, it makes no difference to assume that the strategies are defined 
on a compact subset of [0, œo) or [xo, co) for some xo. For simplicity, one 
may assume that xo = 0. 


One may of course ask whether it is necessary to have a lower bound at 
all on the CAs. The answer is yes, if we want the game to be interesting. 
If there is no lower bound on the CAs then we may always construct a 
species similar to the winning species in Example 2.2.3, that is one which 
sends one player to very low CAs and assign to the rest of its members 
a CA which is just slightly higher than those of the competing species’. 
A winning team is trivial to construct if the CAs are not bounded from 
below. 


2.3 Main results of Paper 1 


In paper 1 we identified the equilibria for the game of teams. Recall the 
definition of the fractions x; in (2.2). In the discrete game, assume that the 
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MCA-constraint is such that C lies on some CA or precisely between CAs, 
that is, 

_ 2at+k 
2M 


C 


for some integer k > 0. (2.14) 


Main results of paper 1 


In the bounded game of teams, a strategy is an equilibrium strategy if and 
only if it is almost everywhere equal to, for some constant K > 0, 


f= TEE S (2.15) 


0, otherwise. 


This is a constant, positive function with support on an interval centered 
around C. There are no equilibrium strategies in the continuous game of 
teams, because it would need to equal (2.15) which is not continuous. In 
the discrete case, A is an equilibrium strategy if and only if it is given by a 
constant b > 0 and if k is odd, 


b, o<j<k 
na(x;) = (2.16) 
alx) ( otherwise 


or if k is even, for b and c non-negative constants that are not both zero, 


b, O<j<k, jeven 
nax) =le 1<j<k-1, jodd (2.17) 


0, otherwise 


In (2.17), not all n4’s are zero by definition of a strategy but either b or c 
can be zero. Conversely, when there exists an equilibrium in the game of 
teams, it is comprised of the above strategies. 


A vizualisation of equilibrium strategies are provided in the figures below. 
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Ya 
C = x3, k even 


Xo xy X2 X3 X4 X5 X6 Xj 


C = WE k odd 


Xo x1 X2 X3 X4 X5 Xj 


The following is a visualization of the equilibrium strategies of the bounded 
game with xp = 0, which is no limitation due to translation invariance. 
Notice that this is a discontinuous function. In fact, this is the reason that 
there are no equilibrium strategies in the continuous game of teams. Any 
continuous function will lose against a continuous function that better 
mimics the equilibrium of the bounded game, but then no function will 
ever be protected against losing the game, so there is no equilibrium. 
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f(x) =Kae. 


for K > 0 and x € [0, 2C] f(x) = 0 a.e. for x > 2C 


Proving these results requires computing the expectation between pairs 
of strategies and using Proposition 2.2.1. In the bounded game we show 
that E[f,g] > 0 for f given by (2.15) and any other strategy g by direct 
computation of E. As mentioned above, given any collection of strategies 
one can assume that they are defined on the interval [0,1] with C < 1/2 by 
the change of variables in (2.12). Then the continuous strategies and the 
discrete strategies satisfy the conditions of Theorem 1 in (Menden-Deuer 
et al., 2021). These are some of the main arguments that prove the results 
of paper 1. 


Equilibrium strategies are positive and constant on an interval centered 
around C. In paper 1 we note that such functions distribute the CAs 
without favoring any values in particular. Every CA is equally probable, 
so the teams will have ‘maximal distribution’ of team members and all 
members are treated equally. This motivates the title of the paper, The 
Strength of Diversity. 


Heuristically the main result of paper 1 may be summarized as follows: 


A team can be guaranteed to not lose by assigning CAs to 
its members in such a way that all CAs within an interval 
centered on C are equally probable. In other words, a winning 
strategy is to create a maximally diverse team. 


Chapter 3 


Decision-making and disease 
outbreaks 


A classical Game Theory case: People are not taking vaccines 
in the hope that everyone else would be vaccinated and they 
would be safe. 


—Vineet Raj Kapoor (2021 on Instagram) 


How many people will be infected in a population within, say, two weeks, 
given the current conditions such as the number of infected individuals 
and transmission rates? These types of questions are effectively answered 
by diving the population into compartments (or categories). Changes 
to the categories are captured by dynamical models which are typically 
differential equations. This chapter introduces some of the standard models 
and presents our contribution to the field. 


The COVID-19 pandemic outbreak in the beginning of 2020 issued many 
questions about people’s behavior during diseases, such as ‘What differ- 
ence does it make if this large a portion of the population complies with 
recommendations while the rest do not?’ My supervisor and I incorporated 
ideas from game theory with the disease spreading models SIR and SIS in 
order to provide some insights to these questions. We realized that the 
individual decisions during a pandemic resemble the prisoner’s dilemma 
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(PD) and we investigated what happens when the population is under 
influence of the PD game while also being aware of the risk of catching 
the disease. This led to insights whether cooperation emerges when the 
game’s payoff is a trade-off between the PD and the effect on disease 
spreading through changes to the infection transmission rate. 


3.1 The early models: SIR and SIS 


Some diseases infer immunity after an infection, while some do not. Im- 
munity can last very long, sometimes as long as a lifetime, and sometimes 
much shorter. Examples of the former is the measles (Vårdguiden 1177.se, 
2019). Common colds and many STIs are examples of diseases that do 
not confer immunity; one can catch the disease again almost immediately 
after recovery. (Niespodziana et al., 2012; Workowski et al., 2021) 


The SIR model 


The following model was an early attempt at describing the dynamics 
among the population during an outbreak of a disease that confers lifetime 
immunity or immediate death. The model cannot differentiate between 
dead and immune because both types mean that the individual — dead or 
immune — does not participate in the disease spreading. 


Assume that the population is divided into three categories, each consisting 
of individuals that are in one of the following states: 


e Susceptible 
e Infectious 
e Removed (dead or immune) 


Denote by S, J and R the number of susceptible, infectious and removed 
individuals, respectively. Let N denote the size of the population, so that 
S+I+R = N. Dynamics in this model are captured by the change of 
state within the population, that is if, say, a susceptible individual gets sick 
then it moves to compartment I and correspondingly there would be an 
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increase by 1 of I while S decreases by 1. 


The classic SIR model assumes that all individuals in the population has 
a certain, constant probability to get in contact with any of the other 
individuals. It further assumes that the probability of disease transfer from 
a infectious individual to a susceptible individual is a positive constant £. 
The number of susceptible individuals can only decrease since the infected 
individuals eventually become removed (by death or — hopefully - by 
becoming immune.) At each time, the expected decrease is proportional to 
the risk of a susceptible individual meeting with an infectious individual, 
that is, S would decrease by PSI. Let S(t.) be the number of susceptible 
individuals at time tp. Then S(tk+1) — S(t) = S(t.) (te) would describe 
this situation.’ 


Susceptible — Infectious tI Removed 


In large populations, it is usually feasible to approximate the integer num- 
bers S, I and R with continuous real values. Therefore we describe the 
dynamics of S by means of the ordinary differential equation $ = —£SI, 
where the dot over S means differentiation with respect to the time vari- 
able. Then the flow scheme above says the the amount subtracted from 
S should be added to the compartment I. The rate at which individuals 
transfer to the removed state is such that R = yI for a constant y > 0. We 


obtain 
S =—fSI (3.1) 
I = fSI-ylI (3.2) 
R=yl (3.3) 


Notice that S+I+R = 0 meaning that the size of the population is constant. 


A sketch of typical time dynamics in the SIR model is pictured below. 
The portion of susceptible (full line) decreases as the portion of infectious 


‘Notice that £ is dimensionless, although, since each timestep is indexed, we may 
argue that it has dimensions 1/(time). 


22 Chapter 3. Decision-making and disease outbreaks 


(dashed line) increases during the outbreak of the disease. After some 
time, there is a portion of removed individuals (dashed dotted line). The 
dynamics stabilize after long time to a steady state with no infectious 
individuals. Notice that there might be susceptible individuals at steady 
state, because with I = 0 there is no flow between the compartments. 


^ 


100% 4 


50% 4 portion of susceptible, S 
KA S portion of removed, R 
ET aE een portion of infectious, I 
on poo 


If we rewrite (3.2) as I = (RoS — 1)yI with Ro = B/y we see that the ratio 
Ro determines whether there is a disease outbreak at small times. Above it 
is assumed that RọS(0) > 1 because otherwise there would be no increase 
of I at small times. 


The SIS model 


Instead of being ‘removed’ as in the SIR model we may assume that recov- 
ery from the disease is immediately followed by the risk of catching the 
same disease again. In other words, ending the disease is a recovery for the 
individual. This situation is correctly modeled if the recovered individuals 
‘flow back’ to the susceptible compartment. That is, the portion yI is added 
at each time to the change of S, giving $ = —BSI + yI. In total, 


S = -ßSI+yI 
I = fpSI-yI 
Since S +I = 1 in this situation, we can eliminate S from the equations. 
The full dynamics is described by 
İ=ßp0-DI-yI (3.4) 


A sketch of typical time dynamics in the SIS model is pictured below. The 
portion of susceptible (full line) decreases as the number of infectious 
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(dashed line) increases during the outbreak of the disease. After some time, 
the dynamics stabilize to a steady state which is characterized by a balance 
between recovery and infection, that is, BSI = yl. 


^ 


100% ~ 


portion of infectious, I 


50% + 
as portion of susceptible, S = 1 — I 


=y 


0% = 
0 


Using (3.4) we compute 


dl I d1 1 
a Pa Vo G5) 
If f + y then 
ma (3.6) 


for some vo € R, cf. (Hethcote, 1989). If p = y then I(t) = 1/(ft + wo) for 
some wọ € R. If 6 > y then I(t) > 1 — y/f ast — œ and if f < y then 
I(t) — 0 as t — œ. The ratio between f and y plays an important role in 
the dynamics, similar to the case of the SIR model. 


More complex models 


There is vast literature on more advanced models that the ones outlined 
above. For instance, one may assume that there is an incubation period 
for the disease. Then the susceptible individuals will not contribute to 
the disease spreading immediately after becoming infected, so there is a 
time delay between catching the disease and moving to the compartment I. 
Further examples of models are found in e.g. Vynnycky and White (2010). 


3.2 Evolutionary game theory 


Recall that a mixed strategy is a probability distribution over the options 
in a game. Playing with mixed strategies, it is standard notation to call 
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px the payoff for playing C with probability x. Assuming that the other 
player in a 2 X 2 matrix game uses the same strategy we can compute the 
expected payoffs. We will do this in the following section. 


Replicator equations of symmetric games 


In most classical applications, game theory focuses on decisions made by 
rational players using cognitive choice. On the contrary, the evolutionary 
application of games specifies a process of natural selection—individuals 
are merely the performers of an inherited program. In a 2 x 2 symmet- 
ric matrix game, a mixed strategy x may be subjected to a ‘replicator’s 
equation, 

<= F(x), (3.7) 
which specifies the change of the strategy. A common model is assuming 
that the strategy changes in proportion to the payoff’s linear deviation 
from the mean, that is F(x) = x(px — (p)), where px is the payoff to x and 
(p) is the mean value of the payoffs. 


Recall the payoff matrix from §1.1.1. We abstract away from the numbers 
of said matrix and denote the payoffs of the 2 x 2 symmetric game by 
R, T,P and S. 


player B 
C D 

é R T 
Wee s 
Ke) 
F S P 
g 

T P 


The symmetric nature of the game implies that the game payoffs can be 
represented by the matrix 

R S 

R3 m 


The entries are the payoffs to player A, where the top row is the payoff if 
A plays ‘cooperate? Now we can define what the prisoner’s dilemma (PD) 
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is mathematically: It is the situation 


T>R>P>S. (3.9) 


Consider a replicator’s equation with F(x) = x(px— (p}). In the symmetric 
matrix-form game we have 
x = x(Rx + S(1 —x) — Rx? — Sx(1 — x) — Tx(1 — x) — P(1 — x)’) 

= x(Rx(1— x) +S(1- x)? — Tx(1 — x) - P(1 - x)°) 

= x(1—x)(Rx + S(1 — x) —Tx — P(1-x)) 

= —x(1 — x)((T — R)x + (P - S)(1 — x)). (3.10) 
We can write x = —x(1 — x)(Djx + D,(1 — x)), where D, = T — R and 
D, = P —S (cf. Tanimoto, 2015, ch. 2). A special case of the PD game is 
the Donor-Recipient game which has D, = D,, meaning that the payoff 
advantage of defection over cooperation is independent of the opponent’s 


choice. Denoting the payoff disadvantage by C (for ‘cost’) we write Dg = 
D, = C. In the donor recipient game, 


x= -x(1-x)C. (3.11) 


Without loss of generality, one can assume that P = 0. In accordance with 
the PD-condition (3.9) we require 


-C<0<R<R+C (3.12) 


and the payoff matrix becomes 


(3.13) 


R —C 
R+C 0 


In the next sections, we will formulate the dynamics using R and C only, 
and forget S, T and P. 


Network reciprocity 


Networks in games represent contacts between players. Only neighbors 
can interact, that is, in the context of disease spreading there are a lim- 
ited number of possible transmission paths of the disease. We make the 
following assumptions: 
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1. What two-steps neighbors do is irrelevant. 


2. We assume the graph is degree-regular, meaning that each node has 
the same number, k, of connecting edges. 


Under these assumptions the cost C in the donor recipient game decreases 
by N(k), where 


Rk — 2C 


NO = TED 


k#2, N(2)=R 

(Tanimoto, 2015; Ohtsuki and Nowak, 2006). Notice that N(k) —> 0 if k > 
oo, which reflects the fact that unlimited network connectivity recovers 
the network-free, well-mixed situation. Now the equation (3.10) modifies 
by the change of the payoff matrix to 


x = —x(1—x)(C - N(k)). (3.14) 


By (3.12), the game is of PD type when N(k) — C < 0 < R, which is 
equivalent to 
0<R<C(k-1). (3.15) 


That is, the benefit of mutual cooperation compared to the cost of miti- 
gation determines whether the game is of PD type. For example, when 
R/C is large, corresponding to low costs of mitigation and/or high benefit 
of mutual cooperation, the game may cease to be of PD type for values 
of sufficiently small values of k such that (3.15) breaks. For sufficiently 
large values of k - in particular for well-mixed populations — the game is 
always of PD type. 


3.2.1 The dynamical beta-parameter 


In the previous section we encountered the equations of the SIR model 
and the SIS model, which both assume that there is a infection rate f such 
that PSI is the portion of susceptible individuals that catch the disease at 
each timestep. The parameter f need not be constant. In our work, we 
have assumed that some individuals in the population are more effective 
at disease spreading, meaning that we associate a larger infection rate to 
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them. We denote those individuals by D and the rest get the label C, so 
that Bp is the infection rate of individuals of class D and £c is the infection 
rate of individuals of class C. By assumption fc < fp. Let p be the average 
over the population, that is if x is the portion of C-individuals then 


p = xpe + (1 - x)fp. (3.16) 


Assuming that the infection rate is determined by individual choice, we 
may interpret D as the game theoretic strategy ‘defection? Similarly, C 
stands for ‘cooperation’ 


In order to model trends in the choice between cooperation and defection 
within the population, we assumed that the portion x is governed by a 
replicator’s equation. The payoffs that each individual perceive is assumed 
to be a balance between contributing to the common good (by cooperating) 
or gaining personal benefits (by defecting). In this situation x depends on 
time and we write x = x(t). 


By interpreting x as the portion of cooperators there is a flow of the 
defectors becoming cooperators given by 


% = ax(1 — x)(Bp — Bol, (3.17) 


where a > 0 is a parameter. The factor x(1 — x) ensures that x remains in 
the range 0 < x < 1. We may interpret (3.17) as a risk assessment managed 
by each individual: If there are many more infectious individuals that do 
not cooperate, then there is more risk of catching the disease and more 
individuals will decide to cooperate, that is, x will increase. 


3.2.2 The combined SIR-PD and SIS-PD models 


We would like to consider the total contribution of (3.17) and (3.14). Notice 
that both equations are on the same form as (3.11). Individuals are assumed 
to consider the total cost as the sum of —a(fp — Bc)I and C — N(k). The 
portion x is thus determined by the choices of individuals making conscious 
decisions based on the risk of catching the disease on the one hand, and 
on the other hand the benefits of the PD-game. These decisions determine 
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the total transmission rate of the disease, which the entire population 
experiences. In the SIR-PD model, 


S= -((1-x)Bp + xfc)SI (3.18) 

T=((1-x)$p + xBc)SI- yl (3.19) 

R=yl (3.20) 

x = x(1—x)(a(Bp — Bc)I - (C - N(k))) (3.21) 
whereas in the SIS-PD model, 

i =((1-x)fp+xßco)( -DI -yI (3.22) 

x =x(1—x)(a(Bp — fc)I - (C - N(k))) (3.23) 


Notice that the portion of cooperators is influenced by I which is itself 
dynamic. This results in a feedback mechanism. If a member of the 
population decides to change strategy from defect to cooperate, then the 
effective disease transmission rate (3.16) is decreased which causes I to 
shrink which in turn causes x to increase. Nevertheless, there are steady 
state solutions to the SIR-PD model and the SIS-PD model as we will see 
in the next section. 


The parameter æ balances the contribution from the term (fp — fc) with 
that of the term C — N(k). We interpret this as a timescale difference. If 
an individual gets updates on the portion of infectious, J, on the timescale 
‘days’ whereas the PD game payoff can be received on the timescale ‘hours’ 
then the PD payoffs have more influence on this player’s decision. In that 
case, a is small. Conversely, if a is large then the information about J is 
acquired frequently and the player acts accordingly. In this interpretation, 
the non-negative sign on a can be thought of as correctness in the player’s 
risk assessment. If the player thinks that a disease is dangerous and if the 
source of information is reliable, then the rational and conscious player 
acts with a > 0. 


3.3 Main results of Paper 2 


Heuristically the main result of paper 2 may be summarized as follows: 
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For a communicable disease that do not infer immunity, the 
quicker individuals access information about the portion of 
infectious individuals in the population the lower is the por- 
tion of infectious individuals at steady state. However, in the 
context of diseases that infer immunity, no one cooperates at 
steady state. 


SIS-PD equilibrium points 
Recall that the SIS-PD model is defined by the set of equations (3.22)—(3.23) 
with Be < Bp. 


Theorem 3.3.1. The equilibrium points of the SIS-PD system are 
(x, I) e€ lo 0), (1,0), b, pe +), (1 ie +), Gar i}. (3.24) 
Bp Bec 


where 


iit PDE 2 Y p = CN) 
Bo-Bc (Bo-Be)Q-I*)’ a(Bp — Bc) 


The equilibrium poins are well-defined and stable under the conditions given 
in the following table. 


(3.25) 


Equilibrium | Condition 

(0, 0) Bp <y, a(C — N(k)) > 0 

(1, 0) Bo <y, a(C — N(k)) <0 
(0,.1—y/Bp) | Bo >y, asa 

(1,1-y/fc) | Po>y, a 24 

(x*, I*) a<a<@0<"<1,0<x* <1 


Here, 


Bo C-N© nd aa fe CNO 


“= Bo-y po-pe “9 “D Pe-y Po- Pe pen 


Since I denotes a portion we must have 0 < I < 1 which is one main 
criterion for the steady states to be well-defined. The same holds for x. 
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Proving the stability of each steady state solution also involves comput- 
ing the Jacobian matrix of the SIS-PD equations. They are stable if the 
eigenvalues of the Jacobian matrix are negative (Chione, 2009). 


Following the values of q, the equilibrium transitions between the asymp- 
totically stable equilibrium points of Theorem 3.3.1. The following table 
shows the equilibria in three regions of a assuming y < fc < fp. The 
transitions occur at & and @, which are defined in (3.26). 


Range Equilibrium 
a<a| (0,1-y/fp) 
<a@<a@ | (x*, I) 

âza | 1-y/Bo 


The following figure is a visualization of the values in the above table. 


x at steady state 


I at steady state 


0% 


> 
0 a a a 


As a increases, the population moves from defection (x = 0) to partial 
cooperation to cooperation (x = 1). At the same time, I, the portion 
of infectious individuals is decreasing. If a is sufficiently large and the 
transmission rate for cooperating individuals, fc, decreases (still keeping 
y < Bc) then the portion of infectious individuals tends to zero. 


SIR-PD equilibrium points 


Recall that the SIS-PD model is defined by the set of equations (3.18)-(3.21). 
Computing the Jacobian of this system, we identify the stable steady states 
precisely like in the above SIS-PD situation. Since S+J+R = 1, the quantity 
R at equilibrium is given by R* = 1 — S* in the following theorem. 
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Theorem 3.3.2. The SIR-PD model always stabilizes to a set of equilibrium 
points (x*, I*, S*) with 


x* e {0,1} I=0 CaS" <1: (3.27) 


All of these are possible; the exact values are determined by initial conditions. 
The equilibrium points with x = 0 are stable if PpS < y. If PpS < y the 
equilibrium point is unstable. All equilibrium points with x = 1 are unstable. 


Only the outcome with no cooperation whatsoever, x* = 0, is stable in the 
SIR-PD model, which is actually expected because the SIR model ‘empties’ 
the I-compartment. At steady state there are no infectious individuals left; 
the SIR model terminates at a no-disease state. Therefore, there is nothing 
to gain from cooperating. Looking at the dynamics before steady state, 
however, there is an increase of cooperators during the outbreak of the 
disease. 
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